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[57] ABSTRACT 

A method and system for determining the authenticity of an 
item such a s an original work of art an art print, valuable 
jewelry or other valuable items utiliz csimages .of one or 
more unique patterns of features, preferably at a microscop ic 
level as one or more "signatures" of the item. The4mage of 
fliis unique signature is recorded and stored elcctronicallv^s 
data representing the unique pattern. The data are registere d 
w<th ■riflqt ifying text and stored in a secure storage locatio n, 
t o prevent unauthorized duplication or use of the stored da ta. 
Following this registration and storage, an item presented as 
authentic can be examined microscopically at prescribed 
sites on the item where the original images were taken. 
Comparison is made at one or more of the sites, and a 
decision is made as to whether the item exhibits substan- 
tially identical features to those originally registered, so as 
to be the same authentic item. Comparison can be made 
electronically or visually/microscopically. The storage loca- 
tion can be a central location remote from local verification 
stations, with data transferred to and from local stations by 
telephone lines or other communication links. 

11 Claims, 7 Drawing Sheets 
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SYSTEM FOR VERIFICATION OF UNIQUE 
ITEMS 

This is a continuation of application Ser No. 075,149 
filed on Jun. 10, 1993, now U.S. Pat No. 5421,984. 

BACKGROUND OF THE INVENTION 

The invention relates to verification of unique items, 
usually items of value, and more specifically to a system for 
registration of unique features of an item, preferably intrin- 
sic features, and storage of data relating to the unique 
features for later retrieval and comparison with similarly 
located features of an item purporting to be the authentic 
article. 

A number of different systems and processes have been 
known for registering items, documents or living beings by 
unique features found on the items or added to the items, for 
later comparison to determine whether an item purporting to 
be the original is indeed the original. Fingerprints, for 
example, have been used for many years as unique charac- 
teristics of each person, to be registered and later compared 
to a person or an impression left by the hand of an unknown 
individual to determine identity. Other methods of identify- 
ing persons based on the same general principle have 
involved voice pattern identification, DNA testing and vari- 
ous other unique physical characteristics of human beings. 

Pattern recognition has been used in the past to identify 
objects, particularly documents. The general approach has 
been to place something having unique physical character- 
istics onto a document or other object, to examine the 
pattern-containing addition for a unique pattern or to know- 
ingly place data or information by a method such as a 
microdot, and to keep a record of that unique pattern or 
information, for future authentication of the article. 

The following patents have some pertinence to the system 
of the present invention, as regards authentication of docu- 
ments or living beings: Bonnaval-Lamothe Pat No. 5,027, 
ID, Taylor Pat No, 4,414,546, Goldman Pat No. 4,811, 
408, Rice Pat No. 4,699,149, Goldman Pat. No. 4,423,415, 
Roth Pat No. 3,778,781, Knop Pat No. 4,661,983, Shamos 
Pat No. 5,071,168, Tal Pat No. 4,975,969. 

The Bonnaval-Lamothe patent is directed toward printed 
information, i.e. documents. The technique of authentication 
employed by Bonnaval-Lamothe involves the concept of a 
theoretically perfect alphabet letter, as an example, as a 
means for identifying a document via minute details. The 
disclosed system, while recognizing mat each printed letter 
on a document has unique characteristics on a microscopic 
basis, due to the differences in the ink's distribution on the 
texture on the paper, records only ''unique deviations" 
between the shape of a printed alphabet letter, in micro- 
scopic detail, from a theoretically perfect version of that 
letter. These "unique deviations" are recorded and used as a 
basis for comparison in a document authentication proce- 
dure at a later date. In the authentication procedure, the 
deviations of the alphabet letter are compared to the previ- 
ously stored unique deviations in an effort to determine 
whether the document being authenticated is indeed the 
same document The disclosed system does not involve 
recording and direct comparison of actual patterns of alpha- 
bet letters or other minute intrinsic features contained in 
documents, works of art or other articles; it looks at devia- 
tions from a theoretical norm. Further, by concentrating on 
a theoretically perfect alphabet letter, the system of the 
patent teaches a system which is generally applicable only to 
printed characters or other regular, known shapes in docu- 
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ments; in this sense the disclosed system does not contem- 
plate the examination, recording and verification of intrinsic 
microscopic features in works of art where such regular, 
theoretically perfect shapes are not present This under- 

5 scores the important difference that the Bonnaval-Lamothe 
patent emphasizes the examination and processing of data, 
data regarding deviation from a supposed norm, not the 
investigation of an image. 
Shamos Pat No. 5,071,168 is specifically tailored to 

to medical specimens, using fingerprint identification. The 
disclosed system, designed specifically for hospital use, 
simply comprises a means to identify patients during hos- 
pitalization. The patient* s fingerprint is digitized and 
encoded on labels and specimen identification tags along 

15 with a bar code. Nothing in the patent indicates any attempt 
to identify or verify art objects or other inanimate objects. 

The Tal patent also discloses a method for uniquely 
identifying human beings, in this case by facial feature 
analysis. The face is scanned as to key parameters, and these 

20 parameters are coded and stored, but the facial image itself 
is not stored. Verification of identity is accomplished by 
repeating the process and comparing the derived data with 
the stored reference data. 
Goldman Pat No. 4,811,168 describes an identification 

25 card system for individuals. A facial photograph on the card 
is digitized and processed, then encoded onto the card itself. 
The data printed onto the card carries information regarding 
what should be detected in an examination of the LD. card 
photo. In other words, the Goldman system simply com- 
prises image verification for a photograph of a human face, 
to authenticate the identification card. Goldman does not 
disclose reviewing in microscopic detail a portion of the LD. 
card or of the photograph, and later making a comparison of 
actual images to determine whether a purportedly valid I.D. 

35 card is the authentic card. 

Goldman Pat No. 4.423,415 relates to an added on 
authenticator tag which is attached to an article. The means 
of authentication is by detecting a * 4 fingerprint"-like pattern 

^ in the pattern of translucency of the paper authenticator tag. 
The patent has little relevance to the present invention, either 
in theory or in applications. 

The Knop patent discloses a method for confirming 
genuineness of a document by comparing preregistercd 

45 micro-data to verification micro-data taken at the same place 
on the document Although the system utilizes microscopic 
examination of a sample and creation of a reference record, 
it uses a very specific inorganic dielectric coating, which 
inherently has a random crack pattern, for developing a 

50 unique recordable pattern for the document Similar to other 
prior systems, Knop uses the addition of a signature-bearing 
device to the article to be authenticated, rather than exploit- 
ing a pattern or image intrinsic to the object 
The Rice and Taylor patents are concerned with identi- 

55 fying individuals by fingerprint-type preregistration and 
later correlation of gathered data against the preregistercd 
data. Rice discloses an alternative to fingerprinting involv- 
ing scanning and recording of patterns of subcutaneous 
blood vessels. The Taylor patent describes the use of "cbest- 

60 nuts" on the joints of horses, providing a uniquely record- 
able pattern which can later be used to verify the identity of 
the horse. This is similar to fingerprint registration of human 
beings. 

Nothing in the patents described above contemplates a 
65 system similar to the present invention described below, 
wherein a valuable object, such as a painting, sculpture, 
stamp, gem, or document is registered for the purpose of 
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subsequent identification, by microscopically examining a painting or other work is ox is not the very same article 
said object and recording one or more images of said which has earlier been examined and registered through the 
object's minute intrinsic features. The collection of the system. This authentication can be performed with a very 
stored reference images, in concert with the remote imaged high degree of confidence, virtually 100% ("authentication- 
communications technology thus becoming the basis for a 5 refers to verification that an item is the same item as 
broad based system for secure verification of works of art previously registered, and does not refer to "authentication** 
and other valuable objects. of Gng"^ non-registered works of art as genuine works of 

a particular artist). The service can be performed at many 

SUMMARY OF THE INVENTION locations worldwide, relatively inexpensively, regardless of 

10 waetner thc ^ objtt* ls brought back to the same location 

The method and system of the present invention, in a where it was originally imaged and registered. Thus, for 
preferred embodiment is based on the premise that every example, museums, collectors and insurers are greatly ben- 
object regardless of its similarity to other objects or copies efltted by the ability to preregister a traveling art exhibition, 
at the normal level of examination by the human eye, has then to periodically examine the exhibited works throughout 
unique intrinsic features at a microscopic level Random or the tour of the exhibit. Museums, galleries and large private 
chaotic processes of nature at the atomic and/or molecular 15 collectors will be benefitted by registering their entire col- 
level ensure that any physical object is a completely unique lections over a period of many years, 
arrangement of atoms and/or molecules. Physical objects Accordingly, the system of the invention comprises a 
may share nominally identical or similar constituent mate- significant contribution to enhancing customer confidence in 
rials and macroscopic features such mat they are rendered fine art purchases and in significantly reducing the risk of 
virtually identical to the human eye as well as to many 20 i oss due to fraudulent substitution in traveling collections, 
common differentiation techniques. However, at some level ^ a preferred implementation of the process of the 
of magnification, any physical object will reveal absolutely invention, optical microscopy is used in combination with 
unique features intrinsic to itself. These features will be a commercial high resolution video imaging, computer and 
direct result of random or chaotic processes of nature or may networking technology, magnetic and optical data storage 
be the result of me creative process of man or a combination 23 techniques and high security techniques. 
°^^ om ' In one implementation of the invention, the preferred 

The process and system of the invention involves exami- method for deterrnining the identity of an item, as to whether 

nation of a physical object at an appropriate level of mag- the item is a particular unique item previously known, 

nification and, using appropriate techniques and procedures, M comprises first detecting and recording a unique pattern of 

detecting and recording one or more absolutely unique features at a selected site of the item, preferably at a 

features or micro-features of that object at a microscopic microscopic leveL Data relating to the unique pattern of 

level, and creating a reference recording of those micro features are stored electronically, and steps are taken to 

features and of their location on the object Hie reference assure the security of the stored against unauthorized 

recording is used in subsequent comparative examination M duplication or use of the data. At a time subsequent to the 

procedures to authenticate an object at a later time, i.e. to storing of the data, a subject item purporting to be the 

verify the object under examination is or is not the same particular unique item is examined, at a site on the item 

object which was originally recorded. corresponding in location to the selected site used for 

Although the system of the invention is applicable to registration of the authentic object originally. A comparison 

nearly any inanimate object one primary area of its appli- ^ is then made between data currently derived and data 

cability is to provide the fine art community with a secure prerecorded, to determine whether a pattern of features 

and robust method to accurately determine and record the exists on thc subject item which is substantially identical to 

intrinsic microscopic signature of any valuable work of fine the unique pattern of features initially recorded, so that a 

art and to use mat recorded signature subsequently to aetcrmination is made whether thc item is the same unique 

confirm the identity of the item by comparison with thc 45 item. 

recorded, registered data. The system of the invention offers in one preferred embodiment the original detection and 

the fine art and insurance industries a significant break- recording of the unique pattern is accomplished by taking a 

through in the never-ending campaign against fraud, theft video microscopic image of the micro-features. The video 

and other mechanisms of loss. The fundamental principle microscope provides a live, moving image which can be 

forming the basis of the process if somewhat analogous to 50 monitored, and thc operator can select a frame to be used for 

the fingerprinting process used in criminology and human the registration. The live video information is digitized and 

identification, although the present process goes further. As fed to a computer for display on the monitor, and the 

stated above, the principle is that at a microscopic level, operator simply selects the appropriate frame or frames 

even virtually identical objects or art prints made from the which are to be used for recording and registration. Text 

same plate contain unique microscopic anomalies created by 55 information is entered via a keyboard, to be stored along 

random physical and statistical effects occurring at the time with the selected frames far registration. From the computer, 

of manufacture or printing, giving each object a unique image storage can be effected locally, such as on optical or 

microscopic '^fingerprint" or "signature*' that is virtually or magnetic data storage, for local use in verification of works 

wholly impossible to reproduce. at later dates, such as for the large collection of a museum. 

The registration and verification system of the invention However, in a more broad based system of the invention, 

microscopically detects, catalogs and retains images of these the locally gathered imaging data are sent via modem or 

minute anomalies or micro-features, as permanent reference other communication link to a central recordin g/registration 

records for use in subsequent identification and verification location elsewhere in the world, where all registration data, 

procedures. images and associated text, are securely retained for later 

The techniques of the invention cannot certify that a 65 verification use. 

particular painting or other artwork was or was not created By the process of the invention, for recording and regis- 

by a particular artist What the system does is to confirm that tration of an intrinsic "signature**, some distinctive mark or 
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characteristic of an item is located, that characteristic being other micro-features, is accomplished via anomalies or 

an essential or fundamental part of the item, and that feature irregularities in the application of ink on the paper or other 

is used as a basis to later confirm the identity of the item. The medium. Thus* counterfeiting of the micro-dot stamp itself 

selection of features is limited to features which are non- will not defeat the verification system, 

dynamic, remaining constant with time. Any object 5 The registration record is immediately encrypted and 

reviewed at an appropriately high level of magnification will electronically transmitted to the reference data base master 

reveal a randomness of pattern, resulting from the processes computer at system headquarters for storage, over telephone 

which created that object, with a wealth of miao-features lines or other communication link The main reference data 

which when recorded will create a natural record at least as base computer receives and temporarily stores the registra- 

unique to that item as a fingerprint to a human individual. 1Q tion record of the artwork. Upon proper verification and 

As one example of the process, it can be used to record, visual confirmation by both the remote station (e.g. at the 

catalog and subsequently identify a fine art lithograph. The artist's studio) and the master recording operator at system 

first step in the process is to examine the finished work using headquarters, the master computer recording operators then 

optical microscopy techniques at some controlled point in conclude the artwork record is valid and accurate. The 

the work's history. Generally this can be the work as 15 record is then included in the on-line catalog of the system, 

produced in the artist's shop, even though the time of Eventually the record can be electronically duplicated and 

recording can be later if desired. transmitted to multiple data storage locations for use during 

When the artist decides the lithograph is complete, the subsequent identification or verification procedures. A hard 
work is microscopically examined, which can be at the copy (printed) record of the registration procedure indicating 
artist's studio, by a cataloging expert familiar with the 20 mat trie work has been cataloged within the main system 
system of the invention, using a special image recording data base is simultaneously produced by the local recording 
system. The local recording terminal uses a secure modem instrument and will accompany the other conventional cer- 
operating over the common telephone system (or another tification documentation for the owner. The actual art object 
communication link) to remain in constant contact with a may optionally be indelibly marked with a microscopic logo 
master computer at a system headquarters location, through- 25 representing the system, to indicate that the work has been 
out the registration process. The operator proceeds to micro- registered using the system. The system of the invention 
scopically explore the artwork' s micro-features. Using allows for high level secure encryption of both the micro- 
established search procedures and high resolution video feature images and accompanying reference data for added 
imaging equipment, the operator will discover and record security against potential tampering or alteration. Also, 
many sets of unique microscopic features of the artwork 30 multiple reference data bases make it increasingly difficult 
itself. Ifre high resolution video images of those features an d for anyone to corrupt the system. Additional proprietary 
t he location oV their sites, at specific locations on the surf ace security procedures can be included to enhance the security 
cfcthe artwork, form the core of the data record to be of the more expensive work. 

registered. These images of micro-features will become th e At any time subsequent to the registration procedure, an 

i ntrinsic features used for subsequent identificatio n/ 33 artwork or other item may be examined for verification at 

v erification. any authorized system terminal. The verification procedure 

Examples of micro-features which can be found in a is carried out in the presence of, for example, a buyer and a 

lithograph include small irregularities in the application o f seller of an artwork purporting to be a particular registered 

i nk, tiny microscopic bubbles trapped in the ink mediu m, artwork. Although the equipment for validation shares simi- 

unique spatial relationship between features of the applied 40 lar capabilities with the recording equipment, validation 



i nks and the libers ot the paper itself. T he physical location equipment cannot record or alter registered reference data. It 
oT the micro-features on the artwork, Le. the location of the 

examination point, is referred to as a Reference site* or base and can be operated by any system authorized and 



simply acts as a remote terminal to the master system data 



' jniorosite**, referring to a site which has been magnified. ?5 trained individual. 
least one and usually more reference sites are microscop i- 45 The validation procedure entails placing the work on an 
cally examined and recorded for any single work. T he a ppropriate examination surface and po sition! np th^friflh 
locations of these sites are then stored i n a video imag e resolution Yfdfift rffl^roscope, probe over a reference site or 
ref erence site index map of tn? w oric This site index map microsite for the artwork, and comparing the actual artwork 
antfthe stored microscopic reference images are then c om- to one of its reference images stored within th e system 
bined and encrypted by computer softw are algorit hms, with so v master data base. To accomplish this comparison, the opera- 
Various text information including tne name or tne work and tor logs his local verification texrninal onto a verification 
t he artist, a serial number or series number if the work is pa rt network of the system by common local, long distance or 
nf a ?gr*eg or HmftM Mitinn, and other relevant info rmation , international telephone lines or by other communication 
This combination now comprises the registration record for links which may be dedicated links, if desired. Once the 
the work. 55 dealer has logged onto me system network, a system catalog 
^bfan optional step which can be employed in appropriate number for the item in question should be entered. When the 
circumstances, such as for relatively inexpensive items or catalog number of the work is verified, the system master 
documents, a registration mark can be added to the work for data base electronically transfers the currently registered 
recording and registration. This can be a small (e.g. 1.0 mm referenced image or images set for that work to the valida- 
te 1 cm) stamped logo or design added adjacent to the 60 tion station, Le. the local terminal. 

artist's signature or the series number, for example, and Next, the reference image or images are compared with a 

appearing as a small dot or symbol to the ordinary observer, local real-time video image of the actual work, at the same 

positioned in such a way as not to interfere with the aesthetic level of magnification, fox correlation. Most works will 

value of the art work. This gives a regular mark and a regular require only a simple visual comparison at the level of 

location for registration and verification, and can indicate 65 magnification involved, far each reference site. The system, 

the fact of registration in the system simply by a naked-eye through the local terminal, can m*kr available a printed 

check. The recording and verification process, as with using copy of the live and reference images, as a record of the 
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validation procedure. More expensive works can addition- fication of a selected reference site on a work of art in 

ally utilize a fully interactive image auto correlation using accordance with the invention. 

the main system computer, at the system headquarters. This fiG. 7 is a graphic representation showing an example of 

auto correlation procedure is fully automated and performed percentages of correlation which might occur between 

in real time. If this auto correlation step is selected, the 5 stored images of a registered item and a fraudulent copy, at 

results of the correlation as well as the hard copy of the different levels of magnification, 
initial visual comparison, is output from the local system 

printer as a paper record of the validation procedure. DESCRIPTION OF PREFERRED 

The validation process may also include another step if EMBODIMENTS 

requested and arranged in advance by a prospective buyer. ^ mc drawings, FKX 1 shows, in a primarily schematic 

When the work was originally recorded and registered in the format a locally based system in accordance with one 

system, ordinarily many reference sites were recorded. embodiment the invention, generally identified by the ref- 

Records for these sites have been combined into discrete sets crence number 10. The locally based system of FIG. 1 

of reference images. Normally, only the first set of images is illustrates some of the features of the invention; it can be a 

used for subsequent verification. At the request of the buyer, ^ stand alone system, or it can essentially comprise a part of 

a virgin set of reference images, ie. a set not previously a nct wark type system shown in FIG. 3, to be described 

used, may be requested for a high level verification ^ systcm 10 cnablcs objects to be viewed 

procedure, giving additional security against tampering. If microscopically, to have minute "signatures" or at micro- 

the work passes correlation using its first set of images, the sites ^ mc objects imaged and recorded along with data and 

high level verification procedure will cause the master 20 ^ fQr rcgistration m ^ system; md it eoablcs ^ ob}C(Jt 

system data base computer to provide a new set of reference ^ to ^ examined microscopically, at sites corresponding 

images and site coordinates to the local verification teiminal, t0 ^ "signatures", for authentication as to whether the 

and the process wOl be repeated with these virgin data using purportedly genuine item is in fact the genuine item which 

different sites from the first correlation proceeding. This nas been registered. 

option will frustrate me unlikely event that a copy of the * ^ showD „ mQ j ffi objcct of vawe u 

reference images could somehow have been obtained which ^ M m ^ ^tcanned by manipulation of 

previously with a covert attempt underway to use such & ^ ^ CTOS 14 / secured OD positioning ^uipment 

copies to deceive the prospective buyer and the remote * 15. The video microscope incor- 

operator. These new reference images will never have been porates an IPD (image pickup device) 16, passing a signal in 

published or previously utilized for any verification. Once *> ^ ^ J^cfaed video camera body 18 having 

used, the new^ of images can become me standard set for a yidco to a 20. ^ 00^^ 

subsequent verifications. T^e process may be repeated until rccciycs a stieam ^ ^ videoimage input in meform 

the number of unused venficaUon datasetsis down to two of ntM ^ mcludes a ^ capture board 19. 

At that time the work should be re-ie^ and registered scans thc ^ 14 ov Tth C surface of 

to again provide a larger number of virgin data sets. * thc object 12 using the computer^ sending signals over a 

Although the system of the invention as discussed above control line 21 to the positioning device 15. Viewing of the 

is particularly applicable to works of graphic art it is also ob ^ 12 | s done preferably at a series of successively 

applicable to other objects which are subject to counterfeit- greater magnifications as further discussed below, with the 

ing and copying. Such other objects can include valuable user viewing the scanning image in real time, as indicated at 

items such as rare coins, stamps, gems and jewelry as well tte left-side image 22 on a video monitor 24 in FIG. 1. (FIG. 

as other art objects such as sculpture, and a broad range of j ^ indicates a right-side image 26 on the video monitor, 

security dependent documents, sensitive parts and items in but this is for instances wherein comparisons are being 

a variety of scientific, research and defense areas. made, as explained below.) FIG. 3 shows a single image 22 

. „„„ « on the left side of the monitor 24, with entered text infer- 

DESCRIPTION OF THE DRAWINGS 45 mation 27 to the right, a coimguration which can be used for 

FIG, 1 is a partially schematic view showing components registration of the art object 12, 

of a basic configuration of a system in accordance with the Also connected to the computer is a keyboard 28, for 

invention, with some items indicated in block diagram form. enabling a user to make text entries which will accompany 

FIG. 2 is a schematic block diagram which shows the » the images selected for rccordingfregistraticm. Such text can 

system of FIG. 1, in more schematic, functional format viewable in a display area 30 of the monitor or more 

■% a * a • a- *i . . ^ preferably in the text area 27 shown in FIG. 3. A mouse 32 

FIG. 2Ais aprocess flow chart u^tm & sUps in locatog ^ ^ CQaDect£d to ^ uta> for 

and im aping recording sites on an article being registered. . , » * J ^ , . . 

c 6 6 * manipulating a cursor or other screen element so as to enable 

FIG. 3 is a schematic diagram, with some components 33 selection of areas for magnification, and also for manipula- 
indicated as blocks, showing a broad based system having a Uon of ^ ^4 magnificatioD of the video micro- 
main or central location where registration data are stored, scopc 14 . A joystick or rolling ball type positioning input 
with communication links to remote local terminals. clement could be used in lieu of the mouse 32. 

FIG. 4 is a schematic diagram similar to FIG. 3, but M indicated in FIG. 1, the computer is connected to 

indicating verification steps using the system of the inven- ^ electronically store data (images and text) in a storage 

tion. device 34, which can have optical or magnetic data storage 

FIGS. 5, 5 A, SB and 5C are schematic views showing an (both referred to herein as electronic data storage). When the 

image and a series of higher level enlargements, illustrating operator has selected one or more micro-features of the art 

a principle of the verification system of the invention. object 12, as determined by an initial naked-eye review and 

FIGS. 6, 6A, 6B, 6C. 6D, 6E, 6F, 6G. 6H and 61 are 65 then viewing of the live video image 22 on the video 

comprise a series of views somewhat similar to FIGS. 5-5C monitor, the operator stops the Yideo microscope at the 

showing verification steps using different levels of magni- selected site and types in the prescribed text information (if 
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this has not already been done) including the micro-feature print, for example. FIG. 5 shows a progression wherein the 
site description and/or coordinates of its location. The opera- operator selects a signature point or area 52 after the 

tor then commits the image and associated text/data infor- precision reference point recording described above. The 
mation to storage 34, using the keyboard 28 and/or mouse area 52 can be selected by naked-eye perusal or by viewing 

32. 5 at a low level of magnification. This is indicated in the block 

FIG. 2 shows this simplified embodiment of the invention 53 of FIG* 2A. 

in more schematic format as a block diagram and showing The recording camera is then increased to the first level of 

information and control flow. magnification, typically 10x. This is shown at 54 in FIG. 5, 

FIG. 2A is a simplified flow chart showing manipulative an enlarged view of the selected site area 52. The enlarged 

steps in selection and storage of micro-feature sites on the 10 site is reviewed by the operator, and if satisfactory, is stored 

item to be registered. FIG. 2A should be viewed in connec- along with its location coordinates and magnification level 

tion with FIG. 5, showing an example of site location, as indicated at 55 in FIG. 2A. The camera crosshairs are 

successive magnification and further site location to arrive at centered on the frame 54 for storage of the frame, and the X 

"signatures" or micro-features to be recorded. and Y coordinates, automatically known from the 

The positioning of the art object or other object on the 15 equipment, are stored. These data are recorded as registra- 

table or work surface of the positioning device 15, in proper tion site No * l > ftamc Na magnification level No. 1. 

location for the video microscope, is indicated in the block Next the operator selects a site within the enlarged frame 

40. The art object is carefully indexed as clearly as possible 54, as indicated in the block 63 in FIG. 2A, either by 

to the machine's mechanical reference points, which con- reviewing the lOx frame 54 or by scanning at the next level 

stitutes low precision positioning. Hie position of the cam- 20 of magnification. In either event, the newly selected site 56 

era 14 is calibrated, so that nominal X and Y positions of the is reviewed at the higher magnification level as the frame 62 

camera can be noted and viewed on the computer* as denoted in FIG. 5, and the process of recording is repeated. The 

in the second block 42. The camera may be moved to a home frame 62 is captured and the video image is stored along 

position of X=0, Y=0, for this purpose. with the corresponding X and Y camera position coordinates 

&s noted in the block 43, the operator first reviews th e 25 the magnification level* as registration site No. 1, frame 

object without magnification, to select macroscopic features, No. 2, magnification level No. 2. This is indicated in the 

typically three, to use as precision reference points, for the block 64 in FIG. 2A. 

camera-to-object high precision position survey. The refer- The next step is to select a new feature 66 within the frame 

ence points selected should comprise easily found land- ^ 62 shown in FIG. 5. Again, this new site may be selected 

marks on the art object and which can be described, such as under the second level of magnification, or the operator can 

the top of a nose or edge of a mouth, tip of a right index first go to the third level of magnification and scan the frame 

finger, end of a road, etc. The next block 44 indicates 62 to locate the area of interest 66. The third level 

movement and zooming of the camera (preferably via the magnification, showing this area of interest 66, is shown at 

mouse 32 in FIG. 1) while the operator observes the live 35 68 in FIG. 5, and the selection step is indicated at 70 in the 

video signal. Systematically, each previously identified mac- block diagram of FIG. 2A. The operator will review this 

roscopic reference point feature is located and its image is third-level image 68 before recording. This highest level of 

centered on the central crosshairs of the video image field. magnification may be about 200x to lOOOx typically. The 

When adequate alignment is achieved, as observed by the selected final image 68, as noted in the block 71 in FIG. 2A, 

operator, the video frame is captured and stored along with ^ is captured and stored along with the corresponding X and 

the camera X and Y position coordinates for that reference Y camera position coordinates, as registration site No. 1, 

point. When all previously selected macroscopic features or frame No. 3, magnification level No. 3 . This step completes 

reference points nave been likewise surveyed and recorde d, the recording procedure for site No. 1. 

a sec oi precision reference points which refer only to readil y Next, all data taken and ternrjorarily stored during the 

recognizable and describabie macroscopic features ofj the ^ preceding steps at site No. 1 are combined and encrypted for 

object itself, now exist and are storea as rereraace datT for transmission and storage, as noted in the block 72 in FIG. 

" the pr ocedure. These index nita are combined with index 2A. This record of text and image information comprises the 

text daia! entered by the operator and stored as an index registration record for site No. 1. 

record for the art object registration. The process will now typically be repeated for additional 

The process goes forward utilizing these surveyed preci- 50 sites on the art object When all high-magnification sites 

sion index reference points to determine all subsequent have been similarly recorded, the collection of site registra- 

camera position coordinates, for "signature'* locations as tion records along with a master index record as described 

selected, relative only to the object itself. Thus, if the art above relative to reference point locations is further 

object is later framed or is examined with edges which are encrypted and stored as the full art work registration record 

somewhat different from those existing when the object was 55 These steps are indicated in the blocks 72 and 74 of FIG. 2A. 

registered originally, the landmarks of the index or reference The enlarged image 68 of FIG. 5 indicates an example of 

points allow calibration of the equipment to correct for any micro-features which might be seen at the final magnifica- 

such change in position of the object relative to the posi- ^ ^ whicn will UIU q UC , non-repeatable and 

tioning device 15, regarding either translation or rotation of distinguishing features beyond those of previous levels of 

the object 60 magnification. As can be seen from the example of succes- 

These precision index points having been determined and sive magnification shown in FIG. 5, at each further magni- 

recorded, the registration process may proceed to the high fication level, more unique features arc brought out At the 

magnification portion of the process. unmagnified level, as shown in the full-frame image 50 of 

The high magnification recording steps can be better FIG. 5, the naked eye would probably not discern any 

understood with reference to FIG. 5. FIG. 5 shows an 63 differences from one limited edition print to another. At the 

artwork 50 comprising, as an example, a rural scene. This first level of magnification as in the frame 54, certain 

can be an original artwork or a limited edition, numbered anomalies between different prints of the same image might 
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begin to appear. At the second level of magnification as 
shown in the frame 62, which might be lOOx, unique 
intrinsic signatures begin to emerge. At the final level of 
magnification 68* which can be, for example, lOOOx, each 
sister print might have an entirely different appearance from 
the others, and the differences might be so strong mat no 
patterns will be recognized as common. This depends, of 
course, on the level of magnification, the paper and ink 
stock, the type of printing plate or printing process used, and 
other factors. 

FIG. 3 shows schematically the registration of an item 
such as an ait object in a system similar to that of FIGS. 1 
and 2 but comprising a network, with a central location 
distant from the local system 10a and connected by tele- 
phone lines 80. satellite 82, with uplink/downlink ground 
facilities 84, 86, or other communication links. The local 
registration component or subsystem 10a is the same as 
described relative to FIGS. 1 and 2. except that instead of 
registration images and data being stored locally, at a data 
storage device 34 and in FIGS. 1 and 2, the information is 
sent over modem or other communication link 88, and the 
communication links as described, to a central or headquar- 
ters 90 for all registration and verification activity. Data are 
received and transmitted via a modem or other communi- 
cation link 92 at the central station 90. 

Similar to the local workstations 10a, the central system 
location 90 has a computer terminal 94, connected to a 
monitor 96 and a text/data entry keyboard and mouse 98. 
The computer terminal 94 communicates with a central 
computer 100 for the system, ie. the network comprising the 
central location 90 and a series of remote local workstations 
such as the station 10a. 

When a work is to be registered under the system of the 
invention, the steps at the local workstation 10a are as 
described above. However, during the registration process, 
the local station 10c preferably is on line with the central 
registration station 90, with an operator at the central loca- 
tion monitoring all steps of the procedure. In the registration 
procedure, the local operator and the central operator work 
in concert with each other, primarily for security. Active 
participation together is required during the registration 
only. During verification, as described further below, the 
local operator can perform all of the correlation steps, while 
on line with the central computer Generally, as also dis- 
cussed below, a machine correlation or auto correlation step 
Is performed at or near the end of a correlation procedure, as 
a final verification. This machine correlation is performed 
only via the central computer and the central operator, where 
the algorithm for auto correlation is located. 

Thus, all item registration records generated at the local 
registration terminals or workstations such as the terminal 
10a are collected and securely stored in the central computer 
100 for the system. Steps are taken to prevent unauthorized 
viewing, copying or use of the stored registration records. 

When an art object or other item is brought to a local 
terminal 10a to be verified as to its authenticity, the local 
operator places the art object 12a on the positioning and 
locating machine 15, registering it mechanically as best 
possible (it may be difficult to locate the object closely, since 
the edges may have changed or the object may be cropped 
or framed, etc.). The camera position is calibrated, as before. 
Communication is made with the central registration loca- 
tion 90, by computer link via the modems 88, 92. The 
process is similar to a computer wide area network function 
or * "bulletin board", wherein the message is queued in the 
order received, for processing by the central system. The 
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central registration location 90 is alerted to the fact that a 
certain item 12a, which has been stated to have been 
previously registered with the system, is to be verification. 
The link is made for data transmission in both directions. In 

5 this case, it is preferred that the actual verification steps be 
carried out by the operator at the secure central location 90, 
to prevent any possibility of fraud at the local station 10a. 

Once the link has been made, the operator at the central 
station 90 sends the registration record data for the art object 

10 previously registered to the local computer 20. The central 
operator is enabled to control the camera and positioning 
machine 15, via the communication link. The central opera- 
tor can do this by using the keyboard or preferably a mouse 
or joystick 98 connected to the computer terminal 94. The 

15 software from the central computer 100 preferably governs 
the process, at least in this preferred embodiment, such that 
the local computer operator at the local terminal 10a cannot 
override the main operator in the verification process. Thus, 
the central computer operator at the central location 90 is 

23 able to manipulate the camera and positioning system 15 at 
the local terminal, so as first to locate the series of index 
points or reference points (preferably three) ou the art object 
12a which purports to be the genuine article. Since these are 
described in stored text and are easily recognizable features 

25 on the art object, the operator has no trouble in going to these 
index points, centering the crosshairs, and making an entry, 
such as by pushing a button on the mouse. This gives 
reference coordinates of the three index paints, enabling the 
system to accurately locate all registration sites, using these 
index points as a correlation base. Even if the art object is 
in a considerably different from the position when it was first 
registered, even with some rotation, the calibration can be 
accomplished if these index points are accurately found and 
eotcred Hie magnification level can be correlated, also, by 

35 the difference in coordinates and software-calculated dis- 
tance between them. Once these index points have been 
properly entered and the system has been calibrated to the 
index points, the process of verification, as represented 
schematically in FIG. 6, can begin. 

40 An art object as identified as 50a, 12a in FIG. 6 is placed 
at the positioning machine 15 for verification. Communica- 
tion is made from the remote local terminal 10a, where the 
object is located, with the central system location 90 as 
noted above. The central operator, after locating the three 

45 index or reference points on the object 50a as described 
above, moves the camera to site No. 1, the site 52 as shown 
in FIG. 6. If desired for security, the local operator can be 
blind to these site locations and even to the three reference 
points for the object, provided this information was origi- 

50 nally stored only at the central computer 100. 

Once the first site 52 is located, enlargement to the first 
level of magnification is performed, producing the enlarged 
image 54a, shown on the left in FIG. 6. FIG. 6 shows a series 
of three columns of successively magnified images, the left 

55 column being for an item 50a which turns out to be a forgery 
or a different print of a limited edition, or for some reason 
not the actual registered item. The central column of images 
represents reference images recalled from storage, ie. from 
the file of the art work registration record. The column on the 

60 right represents how the series of enlarged images would 
appear from the actual item which was registered earlier, that 
is these are the same images shown in FIG. 5 for the actual 
registered 50. 

The first level magnification image 54a is compared with 
65 the reference image S4b< and it is these images 54a and 54b 
which will appear as the first set of comparison images on 
the central computer monitor 56 and also on the local 
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computer monitor 24, as shown in FIG. 4. Images as they those skilled in image correlation techniques. These auto- 
would appear from the genuine item as originally registered, correlation techniques automatically compensate for any 
which item is not necessarily present during the verification slight difference in frame position between reference and 
process, are identified by the same reference characters as live image — differences not obvious to the human eye. One 
used in FIG 5 5 example of an autocorrelation technique (or cross 

In the verification piocess, the central operator compares ™ rrc !f^ n : * * e J"!*" out D to bc . m ° et ^> if 

^_ j . • t . , , r , described in the text Digital Image Processing, by R. C. 

toe recorded site images at each level of magnification. ^ R fi ^ Ad ^ on . Wes iey*Publishing 

Thus as shown in FIG. 6 signature point or site No. 1, Company 1992 pages m 110 and 111. In that text, a basic 

magnification level No. 1, is brought onto me monitor screen equation for a linear correlation technique is given at page 

as images 54a and 54b. The operator notes that with these 10 ^ equation 33-36: 
images at mild magnification (e.g. 10x), there appears to be 
some divergence of the item under verification from the 

registered data. FIG. 7 shows an example of correlation JM'gt*)- f *° f*(a)g(x + a)da 

percentages which might be observed at the three different J ~~ 

levels of magnification, for 10x, lOOx and 200x. As indi- 15 

cated in FIG. 7, the percent correlation at lOx might be, for whcre ♦ u me complex con j U gate, X is linear position and 

example, about 82%, versus nearly 100% if the actual alpha is ampHmde. The ar^t^on of b^s general approach 

registered item 50 were present (and as indicated in the t0 ^ present situation is more like the discrete case given 

image 54 on the right side of FIG. 6). by Gonzalez and Woods in equation 3.3-39, essentially a 

At the next level of magnification, i.e. signature point No. 20 summation for two dimensional correlation. The image 

1, magnification level No. 2 as depicted in FIG. 6, images correlation in the present invention is in effect a superim- 

62a of the presently tested item and 62b from registration position of f(x) to g(x) and then a translation to X and Y. The 

storage are compared. Here, considerably more divergence present system also preferably includes rotation to find the 

is noted, although there may be some overall sirniJarity or correct overlay position, and a third dimension which is 

some pattern siniilarity within the image. The images shown 25 tnagaification level, although these latter two steps can be 

in the drawing assume a second level magnification of lOOx. P**™* I inanuaUyMsually by the operator. If all done by 

The graph of FIG. 7 indicates a much stronger divergence at n»to the latter two steps can be each be accomplished 

this level, showing approximately 32% correlation, versus by multiple iterations. 

nearly 100% for the actual, genuine item. u For <* ualiutive * e , of ^ hvendoi 

A \ , . _ J£ 1f ° ._ , . 30 achieves autocorrelation preferably by taking the reference 

At the third and final level of magnification images 68a . ^ a reverse (ncgati ve) of the reference 

and6toare compared on the video monitor. At, for example, . meD superimposing that reverse image with the 

200x, the operator may detect virtually no similarity . t ^ investigated. The superimposed images are 

between these images FIG. 7 shows an image correlation of reviewed pixd by If autocorrelation is found, the 

only about 3%. This denotes that the item is definitely not 35 ^ and ^ • cs ^ a ^ ^ cCL 

Aepurpartedly authentic item, but rather a sutetitate^t the DCUtral ^ ^ ovcrtyIn valucs averagmg to mc ^ 

forest level ofinapfica^ only tf ^ £^ cs „ ^ m cven l^ certain 

a fraction of a nnllimeter of the original artwork surface is reco ^f e partenis ^ emerge , lcading the operator to 

being reviewed. At tins level, between different prints of the ^ obvious positioning steps, 

same art work or between a genuine and a forged item, as ^ ^ ^ autocorrclation techniques are well 

examples, aberrations are the rule, not the exception. to mose in me fic la\ and it should be pointed 

It is also important at this level of magnification, and with out that the requirements for this type of autocorrelation, 

the limited image reviewed, that the operator be sure the site between two still images, are far less demanding than those 

reviewed on the art work 50a is completely accurate. The discussed in the reference text noted above, relating to 

camera is zoomed into the final level of magnification by the 45 finding the closest match between an unknown image and a 

operator in such a way that corrections are made as to lateral set 0 f known images, which can be employed in military 

position if required as zooming progresses. The operator applications. 

monitors the image as he zooms. This avoids migration After successful correlation has been achieved with the 

away from the site of interest, which could lead to an above process, the documentation of the verification proce- 

erroneous finding of near-zero correlation. To optimize 50 dure can be performed. This may include issuing of an 

camera position during this process the operator may wish to authenticity certificate and/or other evidence mat the veri- 

scan the camera to include areas immediately adjacent to the fication has been performed and certifying that the article 

image 68a (this is particularly true if high correlation was brought in for verification is indeed the article originally 

found at the second level of magnification, but almost no registered. If a certificate is issued, it preferably includes 

correlation at the third level). For these reasons, it can be 55 prints of low resolution images, at the highest magnification 

seen that a careful review at each successive level is impor- leveL, showing evidence of the correlation for the customer, 

tant to arriving at an accurate conclusion. As noted above, the verification process typically is 

Once the final level of magnification has been achieved conducted using "in service** reference data. At the custom- 

and successful visual correlation between objects and ref- er's request, a higher level of security can be achieved by 

erence data exists, a machine correlation (sometimes 60 going to virgin data, i.e. additional sets of reference points 

referred to as autocorrelation) may be performed to quantify which have been stored in the central computer and were 

the degree of match between the object and the high- made a part of the registration record, but which have 

magnification reference image. A pixel-by-pixel correlation, heretofore been unused for any verification. These virgin 

performed by the host (central) computer, yields a numerical data, which are called into service at the customer's option, 

percentage correlation factor as represented in FIG. 7 and as 65 then become the "in service" reference data for future 

discussed above. An example of an autocorrelation tech- verification processes, and the previous in service data are 

niquc that can be used is "thumb tack correlation^ known to discarded and not used further. 
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It should be understood that certain preferred features of 
the method and system of the invention as described above, 
although preferred, could be accomplished by alternative 
means. For example, the control of the registration process 
and also of the verification process, and the participation of 5 
operators at the local terminal and the central data storage 
location, can be varied. If the local station is connected by 
modem/tel ephone line or other communication link to the 
central location during these processes, the local operator 
can place the artwork or other item on the video stand, but 10 
all other aspects of the location and recording of images can 
be under the control of the central location operator, if 
desired. With computers at the local station and the central 
location connected, the video microscopic camera place- 
ment and movement can be controlled by the central loca- 15 
tion operator, with images selected by that operator and 
recorded. In that event, the local station operator merely 
observes the process on the video monitor, as can the 
customer. This arrangement can help assure security and a 
general consistency in the type of "signature** features which 20 
are selected for registration. Also, mis can help assure a 
consistent judgment in the verification process, and through 
this arrangement a machine verification ox autocorrelation 
verification can be performed via the central location and 
computer software contained at the central location, with the 25 
local operator observing the process. 

On the other hand, the system and process can be under 
the control of the local station operator, if desired, preferably 
with the central location operator monitoring the registration 
and verification processes and having input to the local 30 
operator through the communication link. Approval of the 
central location operator can be required when the process 
steps at the local station have been completed, before the 
item in question is actually registered. Similarly, in the 
verification process the central location operator's approval 35 
should be required, if the verification steps are conducted at 
the local station. 

In another variation of the system, the process of regis- 
tration could be accomplished at the local verification station 
alone, without any communication link to the central data 40 
storage location at that time. A data storage disk can be 
generated at the local station, carrying all the registration 
data for the artwork or other item in question, and the disk 
or a copy of the disk can be sent to the central data storage 
location. Upon the need for a subsequent verification, a disk 45 
could be ordered from the central data storage location, to be 
sent to the local station, or more preferably, a communica- 
tion link could be established at that time, so that the 
verification process could then be conducted at the central 
location with monitoring by the local operator, or by the so 
local operator with monitoring by the central location opera- 
tor. In this sense, in the claims the term "communication** is 
used in the context of sending data between the central 
location from the local verification station, and this term 
refers to sending such data either via a communication link 55 
or by physically transmitting a data disk or other storage 
device. Similarly, the term "communication link" refers to a 
telephone line/modem connection, a connection over dedi- 
cated lines, a satellite communication link, a ground-based 
wireless link or other appropriate type of link capable of 60 
transmitting data in both directions. 

The term ''microscopic" or "magnified** as used in the 
claims is intended to mean at least about 5 times magnified, 
as viewed by the operator, more preferably at least 10 times. 

Although video is the preferred medium for the process of 65 
the invention, other media could be employed, so long as 
convenient, efficient storage is possible, preferably elec- 
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tronic storage such as magnetic storage or optical disk 
storage, and preferably with wire or wireless data transmis- 
sion available and easy retrieval, cataloging and sorting of 
the data representing the images, ft is an important feature 
of the invention mat actual images are viewed, selected, and 
stored, and the computer equipment for handling these 
images should efficiently commit the images to electronic 
data storage as discussed previously. 

The above described preferred embodiments are intended 
to illustrate the principles of the invention but without 
limiting its scope. Other embodiments and variations to 
these preferred embodiments will be apparent to those 
skilled in the art and may be made without departing from 
the essence and scope of the invention as defined in the 
claims. 

We claim: 

1. A method for registration and verification of items, to 
confirm whether an item is a particular unique item previ- 
ously registered, comprising: 

providing a central data storage location and a plurality of 
local stations, 

providing a data communication link between one of said 
local stations and the central data storage location, 

initially performing a registration procedure on a particu- 
lar unique item at said one local station by 

(1) placing the item on optical equipment enabling 
microscopic viewing at the local station and capable 
of recording microscopic images from the item, 

(2) selecting a microsite for imaging on the item by 
microscopically viewing the item and selecting the 
microsite, 

(3) recording at a microscopic level of magnification an 
image of a unique pattern of features at the selected 
microsite of the item, said unique pattern of features 
being intrinsic to the item itself without any addition 
to the item, and 

(4) in conjunction with the recording step, producing 
and electronically storing, using a computer, data 
representing the microsite Image and containing the 
unique pattern of features, in a form capable of use 
in reproducing the microsite image, along with data 
representing the location of the selected microsite, 
and along with data identifying the item being 
registered, 

providing security to prevent unauthorized duplication, 
alteration or use of the stored data, 

communicating said data to a computer at said central 
data storage location and storing said data at the central 
data storage location, 

at a time subsequent to the storing of the data at the central 
data storage location, performing a verification proce- 
dure by 

(a) recalling over a communication link the stored data 
from the central data storage location to a selected 
one of said local stations, 

(b) exaroining at said selected local station at a micro- 
scopic level of magnification a subject item purport- 
ing to be said particular unique item, at a site on the 
item corresponding in location to said selected 
microsite in accordance with the recalled data, 

(c) comparing the image of the microsite generated by 
local examination to the microsite image recalled 
from the central data storage location to determine 
whether the two microsite images match to a prese- 
lected degree, thereby determining whether the sub- 
ject item is the same unique item, and 
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(d) controlling the verification procedure from the 
central data storage location, at least to the extent of 
verifying said selected local station for access to the 
stored data before the stored data are recalled to the 
selected local station. 5 

2. The method of claim 1, wherein the step of recording 
an image, at a microscopic level of magnification is accom- 
plished at a magnification of at least about 200 times as 
viewed by an operator. 

3. The method of claim 1. wherein step (c) of comparing 10 
the two micro site images is accomplished by autocorrela- 
tion. 

4. The method of claim 1, wherein step (c) of comparing 
the two microsite images is accomplished by an operator. 

5. The method of claim 1, wherein the step of recording 15 
an image at a microscopic level of magnification is accom- 
plished at a magnification of at least about 5 times as viewed 
by an operator. 
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6. The method of claim 1, wherein the step of recording 
an image at a microscopic level of magnification is accom- 
plished at a magnification of at least about 10 times as 
viewed by an operator. 

7. The method of claim 1, wherein the unique item is an 
item of fine art 

8. The method of claim 1. wherein the unique item is a 
limited edition print of an original work of art 

9. The method of claim 1, wherein the unique item is a 
postage stamp. 

10. The method of claim 1, wherein the unique item is a 
piece of sculpture. 

11. The method of claim 1, wherein the unique item is a 
piece of jewelry. 
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